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A METHOD OF REAL-T TMF, BPOAPCAgT'TKrr; QF MUL TIMEDIA 
FILES DURING A VIDEO CONFERENCE, WITHOUT BREAKING 
COMMUNICATION . AND A MAN /MACHINE INTERFACE FOR 

IMPLEMENT AT ION 



The invention concerns a method of real-time 
broadcasting of multimedia files during a video 
conference, without breaking communication, and a man- 
machine interface for implementing the said method. 

To conduct a video conference, use is made of a 
video conference terminal conventionally cpnsis'ting of 
computer equipment, dedicated or not. It may therefore 
be a case of a computer of the PC type equipped with 
video conference functions. The computer is then 
coupled to audio and video signal capture sources 
(camera, microphones) . The computer is also equipped 
with software for processing the signals captured and 
processing the signals received, means of connection to 
a telecommunication network and a man/machine interface 
for displaying on the screen a so-called ''local" window 
and at least one so-called "'distant" window. 

In the remainder of the description a video 
conference terminal will be spoken of in order to 
designate any terminal equipped with means for 
establishing video conference communications through a 
telecommunication network with one or more other video 
conference terminals . 
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During a video conference, a participant, having 
a video conference terminal, may wish to broadcast in 
real time a data file, in particular a multimedia file, 
5 to his fellow participants. Broadcasting is spoken of 
to designate the fact that the receiver never has the 
broadcast file available to it. 

The sending participant is hereinafter designated 
10 as the ""sender". The multimedia files are for example 
video files which the participant has recorded and 
which he wishes to comment on, musical extracts, or any 
other multimedia file that the terminal can use. These 
files are, for example, videos to the MPEG-1 format or 
15 music to the MP3 format. 

One solution currently adopted in video 
conference terminals consists of transmitting the 
multimedia file in its entirety to the participant 
20 through a data channel separate from the audio and 
video channels of the communication. The participants 
then receive the file as it exists on the computer of 
the sender. 

25 This solution raises several problems: 

- A first problem stems from the fact that the 
operation does not truly take place in real time with 
the current communication, the transmission time 
30 depends on the size of the file and the bandwidth 
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available on the separate channel used. 

- In addition, the sender is obliged to perform 
several operations and manipulations which are not very 

5 economic, the consequence of which is to momentarily 
break the communication. 

- Moreover, there is a risk of the receivers not 
having available equipment capable of using these files 

10 (for example: the sender wishes to send a video coded 
with the MPEG-l standard to the receiver, the receiver 
does not have an MPEG-l decoder and therefore he cannot 
decode the file) . 

15 - And finally, the sender makes his multimedia 

file available to his receivers, which he would wish to 
be able to prevent. 

To summarise, this solution amongst other things 
20 poses problems of real time, economics, breakage of 
communication and security of operation. 

Another solution is afforded by standards of the 
T.120 type. According to these standards, it is 
25 possible to effect a sharing of applications between 
video conference participants. 

The sender has for this purpose a list of 
primitives enabling him to transmit the events which he 
30 generates, 2D images or screen captures of the video 
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conference terminal which he is using- However, the 
sender does not have the possibility of controlling the 
bandwidth which he uses and does not have the 
possibility of transmitting audio data. 

5 

In addition, if the receiver is not able to 
support the document sharing standards, the 
broadcasting of a multimedia file is impossible. 

10 For the purpose of resolving these problems, the 

invention proposes a method of broadcasting data files, 
in particular multimedia files, during a video 
conference using a sending terminal able to establish a 
communication with one or more receiving terminals, 

15 these terminals being equipped with audio and video 
sources, principally characterised in that the 
broadcasting of the files is carried out in real time 
with the current video conference communication, 
without breaking this communication, using the audio 

20 and video channels open for this communication. 

The method also comprises a step implemented when 
the video conference communication is established, 
consisting of a dialogue between the sending terminal 

25 and the receiving terminal or terminals in order to 
negotiate one or more communication parameters and 
compliance during the broadcasting of a multimedia file 
with the constraints fixed for the said audio and video 
channels and those of the receiving terminal or 

30 terminals. 
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A first parameter negotiated is the bandwidth 
allocated for the audio and video channels of the video 
conference communication, the multimedia files being 
5 broadcast in compliance with this negotiated bandwidth. 

A second parameter consists of the frequencies of 
the audio and video streams of the streams captured by 
the audio and video sources, the multimedia files being 
10 broadcast in compliance with these frequencies. 

A third parameter is the frame size of the images 
broadcast, the resulting images issuing from the video 
sources and from a multimedia file complying with the 
15 negotiated size. 

A fourth parameter is the coding standard of the 
bit streams of the audio and video sources, the bit 
streams of a multimedia file being coded with the 
20 codecs (coding-decoding algorithm) negotiated. 

According to another characteristic, the video of 
a multimedia file to be broadcast is decoded and mixed 
in real time with the video issuing from the video 
25 capture source of the sending terminal and then coded 
according to the video coding standard negotiated. 

According to another characteristic, the audio 
data of a multimedia file to be broadcast are decoded 
30 and mixed in real time with the audio data issuing from 
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the audio capture source of the sending terminal and 
then coded with the audio standard negotiated. 

Advantageously, the broadcasting is implemented 
5 by a program whose execution is launched by means of a 
man/machine interface implemented in the sending 
terminal . 

The invention also concerns a man/machine 

10 interface for a terminal equipped with means for 
effecting video conference communications and input- 
output peripherals, the said interface comprising 
graphical representation means for displaying several 
windows, one of which is said to be ""local" for 

15 displaying during a video conference communication a 
local video image broadcast to one or more distant 
terminals and at least one second so-called ""distant" 
window for displaying at least one video image issuing 
from a distant terminal, 

20 principally characterised in that the graphical 

representation means also make it possible to display 
at least one other window in order to reveal, in the 
form of icons for example, data files, in particular 
multimedia files, available from the terminal, the said 

25 interface also comprising a logic module providing 
coupling between the operations of selecting a file and 
of movement in the ""distant" window and the launch by 
the video conference means of a program for 
broadcasting the said file in real time with the 

30 current video conference communication, without 
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breaking this communication, using the audio and video 
channels open for this communication. 

According to another characteristic, the 
5 interface is implemented by a computer program launched 
by the video conference means. 

The invention also concerns a computer terminal 
comprising means of running a video conference, 
10 principally characterised in that it comprises a 
man/machine interface as described above. 

Other particularities and advantages of the 
invention will emerge clearly from a reading of the 
15 description made below which is given by way of non- 
limiting example and with regard to the accompanying 
drawings, in which: 

Figure 1 depicts the diagram of a video 
20 conference system between a plurality of video 
conference terminals , 

Figure 2 depicts a view of a video conference 

terminal TA for the sender A, during a communication, 

25 

Figure 3 depicts a view of a video conference 

terminal TB for the receiver B during a communication. 

Figure 4 depicts a view of the video conference 
30 terminal TA for the sender A and of the interface I for 
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broadcasting the multimedia file. 

Figure 5 depicts a view of the video conference 
terminal TA for the sender A during the broadcast of a 
5 file selected by the said sender. 

Figure 6 depicts a view of the video conference 
terminal TB for the receiver during the broadcast of 
the multimedia file, 

10 

Figure 7 depicts the broadcast algorithm 
implemented according to the method by the video 
conference terminal TA, 

15 Figure 8 depicts the reception algorithm for the 

audio and video signals by a receiving terminal TB. 

The invention concerns in general terms a method 
of broadcasting a data file during a video conference. 
20 It applies particularly to the broadcast of multimedia 
files during a video conference from a video conference 
terminal, this example being taken for the remainder of 
the description. 

25 As will be seen in more detail hereinafter in 

relation to Figure 1, the terminal TA of the sender A 
is equipped with means of implementing the method 
according to the invention. These means make it 
possible to broadcast a multimedia file in real time 

30 with a current video conference communication, without 
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breaking this communication, using the audio and video 
channels open for this communication. These means are 
coupled with a man/machine interface I which enables 
the sender to perform a very simple operation for 
5 broadcasting the required file. 

In the description given below and for the 
purpose of simplifying the disclosure, a video 
conference between two participants A and B is 
10 described, during which one of the participants A (the 
sender) will broadcast a multimedia file. Naturally the 
invention is not limited to this case and can easily be 
transposed to scenarios involving several participants. 

15 Consequently the example has been taken of 

participants A and B, equipped with video conference 
terminals on PCs. The video conference terminal A is 
therefore equipped with means of implementing the 
method according to the invention, whilst terminal B 

20 can simply be a conventional video conference terminal 
(the terminal TB of B is for example video conference 
equipment to the H.323 or SIP standard) . 

It is assumed that, during a video conference 
25 communication, the sender A will broadcast a video 
which he has available on his computer and which he 
wishes to comment on to his opposite number B. 

As long as the sender A has not performed any 
30 action from his man/machine interface I in order to 
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broadcast the file which he wishes, the bit-stream 
which he sends to his opposite number B consists of his 
image captured by a camera C and then coded and his 
speech captured by one or more microphones M and coded. 
The coding standard for the video is for example the 
H.263 and the coding standard for the speech is for 
example in compliance with the G.711A standard. 

On the terminal TA, and as can be seen in Figure 
2, three dialogue windows are opened, one entitled 
""file explorer" revealing, in the form of icons for 
example, the multimedia files which it has available, 
the other entitled ''distant" consisting of the image 
received from its opposite number, and the last 
entitled ''local" containing the image which it is 
transmitting . 



The diagram in Figure 
the terminal TB for the 
communication. He can see 
window displaying the image 
TA, and a "local" window of 



3 illustrates the view of 
participant B during the 
on his screen a "distant" 
transmitted by the terminal 
the image transmitted to A. 



When the communication is established, several 
parameters and constraints between the two terminals 
are negotiated. This is the case, as will be seen in 
more detail below, of the size of the frames 
transmitted (eg 176 x 144 pixels) the maximum bandwidth 
used (for example 128 kb/s), the maximum frequency of 
the frames (for example 15 images per second), and the 
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audio and video coding standards used. The 
communication protocol used for this negotiation can 
for example be the H.323 standard. 

5 After negotiation of these parameters, the 

communication proper begins; during this, the sender 
decides to broadcast a multimedia file in order to 
comment on it to his opposite number. 

10 The sender A will for this purpose use the 

man/machine interface I according to the present 
invention. In order to understand the remainder 
reference can be made to the diagram in Figure 4 . 

15 The sender A directs the pointer of the mouse of 

his computer to the icon of the file which he wishes to 
broadcast to B, captures it by pressing on the right 
hand button of the mouse and slides it onto the 
"'distant'' window. If he does not deposit the icon on a 

20 ''distant" window of the terminal, nothing happens and 
the communication follows its course. If the icon is 
deposited on one of the windows belonging to the 
man/machine interface, the broadcast of the multimedia 
file to the receiver B is commenced. 

25 

The operation requires a click and a mouse 
movement, that is to say a few seconds. The sender A 
can perform it without his eyes leaving the video 
conference terminal, and therefore without suspending 
30 the communication. 
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The interface is implemented by the graphical 
representation means of the terminal and a logic module 
PROG-F. This logic module is a program which provides 
5 the coupling between the operations of selection of a 
file and movement in the '"distant" window and the 
launch of a programme PROG~D for broadcasting the said 
file in real time with the current video conference 
communication, without breaking communication, using 
10 the audio and video channels open for this 
communication . 

The broadcast is made under the constraints and 
conditions negotiated at the initiation of the 

15 communication (size of the image, codec (coder-decoder) 
used, bandwidth) , which ensures the correct functioning 
of the decoding, on the receiver side. In addition, it 
does not require any renegotiation of the parameters 
nor opening of new audio and video logic channels, 

20 since those opened for the communication are used. 

The local image captured by the camera C of the 

transmitter A is replaced by the video contained in the 

broadcast file F and an image-in-image insertion of the 
25 video of the sender A. 

Likewise, the sound coming from the sender A is 
mixed with the audio data contained in the multimedia 
file (if such exists) , which affords continuity of 
30 communication, the visual and audible link between the 
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two participants not being broken. 

These results can be seen on the ^'local" window 
of the display screen of the sender A and on the 
5 '"distant" window displayed on the screen of the 
terminal TB, Figures 4 and 5. 

When the end of the file is reached, the video 
sent switches onto the locally captured video of the 
10 sender A and the video conference continues. 

The broadcasting method is implemented by the 
algorithm illustrated in Figure 1, which is executed by 
the program PROG-D produced for this purpose. This 

15 algorithm is run during the execution of a computer 
program produced for this purpose. The execution is 
activated when the sender A performs the operations of 
selection of a file and movement in the '"distant" 
window of a participant by means of the program module 

20 PROG-F. 

This multimedia file broadcast algorithm is 
implemented on the terminal of the sender A. On the 
receiver B side, the terminal TB receives data from the 
25 network and processes them conventionally as 
illustrated by the algorithm in Figure 8. 

Its steps are as follows: 

30 10 - On establishment of the video conference 
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communication a dialogue between the sending terminal 
and the receiving terminal or terminals is carried out 
in order to preferentially negotiate several 
communication parameters for compliance with the 
5 constraints fixed for the said channels, audio and 
video, and those of the receiving terminals, during the 
broadcast of a multimedia file. 

100 - Selection of a multimedia file which the 
10 sender A has. These multimedia data files are stored on 
any medium: hard disk of the terminal TA, diskette or 
other . 

110 - Audio data are captured by the audio source 
15 (one or more microphones) . 

120 - Video data are captured by the video source 
(one or more cameras) . 

20 200 - The data of the multimedia file are 

processed in order to be transmitted over the network 
respectively in an audio processing chain 210 and in a 
video processing chain 220. 

25 300 - The data of the audio capture 110 are mixed 

with the data issuing from the audio processing chain 
210 and the data issuing from the video capture 120 are 
mixed with the data issuing from the video processing 
chain 220. 

30 
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400 - The audio and video data are coded 
respectively. A coding 410 to the audio standards 
adopted for the communication is performed. A coding 
420 to the video standards adopted is performed. 

5 

500 - The data are transmitted over the network 
using the audio and video logic channels of the video 
conference . 

10 The audio processing chain 210 comprises the 

steps of extracting audio data -211, decoding -212^ 
frequency matching 

-213 and stereo/video matching -214. 

15 The video processing chain 220 comprises the 

steps of extracting the video data -221, decoding -222, 
spatial sampling -223 and temporal sampling -224. 

All these processing steps are carried out under 
20 the following constraints: 

• Compliance with the bandwidth: the channels used 
for the broadcast being the logic channels 
already open for the communication, the audio 
25 and video bandwidth measurement mechanisms are 

always used only before the broadcast. Thus the 
bandwidth allocated for such and such a channel 
is never exceeded. 

30 • Compliance with the frequencies of the audio and 
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video channels: at the start of the broadcast^ 
the reading and decoding of the multimedia file 
is commenced- The frequencies of the video and 
audio streams of the multimedia file may be 
5 different from the frequencies negotiated, it is 

then ensured that the frequencies of the streams 
captured by the audio and video sources, 
considered as masters, are complied with. For 
example, if the frame frequency negotiated 
10 during the communication is 15 images per second 

and the multimedia file is sampled at 30 images 
per second, only one image out of two of the 
multimedia file will be broadcast. 

15 • Compliance with the frame size: the image 

resulting from the master stream and slave 
stream is resized where necessary in order to 
fit in the size negotiated at the start of the 
communication . 

20 

• Compliance with the coding standard: 

The coded bit stream sent to the opposite number 
consists of: 

25 

- for the video, the mixture (optional), coded 
according to the codec used during the communication, 
the unprocessed video captured by the camera and the 
decoded video of the multimedia file (the real-time 
30 image of the sender and the MPEG-1 video of the 
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multimedia file are mixed and coding is carried out 
with an H.263 codec) . 

For the audio, a mixture (optional) of the 
5 voices of the sender and the sound data of the 
multimedia file (if such exist), coded according to the 
codec negotiated for the communication (eg the sounds 
emitted by the sender are mixed with the audio data of 
the multimedia file) . 

10 

Such a mechanism ensures the broadcasting of a 
multimedia data in the negotiated format of the video 
conference (audio and video coding standard, bandwidth, 
etc) and therefore the correct decoding on the receiver 
15 side. Thus, in order to assist with the broadcasting, B 
needs no other equipment than that which he normally 
uses. 

Reference can be made to the diagram in Figure 8, 
20 which illustrates the decoding algorithm for the data 
coming from the network on the receiver side, that is 
to say on the terminal TB side. This algorithm 
comprises the following steps: 

25 600- Reading of the data coming from the network 

on each logic channel. 

700- Decoding according to the standards adopted, 
710 audio decoding, 720 video decoding. 

30 
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800- Rendition on the equipment of the receiver, 
810 rendition on the audio equipment, 820 rendition on 
the video equipment. 

5 The same means are used as for the video 

conference, which guarantees for the receiver a correct 
reading of the audio and video data coming from the 
sender . 

10 The invention which has just been described 

consequently concerns an intuitive man/machine 
interface and the technological tools necessary for the 
broadcasting of multimedia files in real-time during a 
video conference. This interface and these broadcast 

15 tools afford continuity of communication between the 
participants, and ensure that all the receivers will be 
capable of seeing and hearing the files broadcast, 
whilst complying with the negotiated constraints of the 
communication (bandwidth constraint, real-time 

20 constraints) . 

This is because, with the present invention, the 
broadcasting of the multimedia files takes place 
transparently for the receiver, that is to say he needs 
25 no equipment other than that which he uses for the 
video conference. 

The open video and audio logic channels of the 
communication are used for transmitting the data of the 
30 multimedia file mixed (or not mixed if the file has no 
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audio or video data for example) with the data 
generated by the sender, and then coded with the codes 
used for the communication. This mechanism ensures the 
broadcasting of - the file to the receiver, and this 
5 broadcasting takes place under the same constraints of 
the communication (real-time, bandwidth never exceeded, 
etc) . Moreover, this broadcasting method is coupled 
with an intuitive man/machine interface, which requires 
only a few mouse operations and ensures continuity of 
10 the visual and sound link between the participants in 
the video conference. 



15 
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